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Abstract The Solar Dynamics Observatory (SDO) Education and Public Outreach (E/PO) 
program began as a series of discrete efforts implemented by each of the instrument teams and has 
evolved into a well-rounded program with a full suite of national and international programs. The 
SDO E/PO team has put forth much effort in the past few years to increase our cohesiveness by 
adopting common goals and increasing the amount of overlap between our programs. In this paper, 
we outline the context and overall philosophy for our combined programs, present a brief overview 
of all SDO E/PO programs along with more detailed highlight of a few key programs, followed by 
a review of our results up to date. Concluding is a summary of the successes, failures, and lessons 
learned that future missions can use as a guide, while further incorporating their own content to 
enhance the public's knowledge and appreciation of NASA’s science and technology as well as its 
benefit to society. 

Keywords: Solar Dynamics Observatory, Education and Public Outreach 

1. Introduction 

This paper provides an overview of the education and public outreach (E/PO) 
program associated with the SDO mission. Reflecting on our efforts leading up to 
launch, we will provide insight into the programs developed, the lessons learned, 
and provide a model for future missions to build on. 

Many stakeholders (NASA, Department of Education, National Research 
Council, etc.) understand the inherent value of imbedding E/PO programs into 
missions and scientific research environments. The close connection to the 
science and data coupled with the co-operation between scientists and education 
specialists is imperative to successful engagement of the public and fostering their 
curiosity (NRC, 2011). NASA and the Heliophysics Science Division (HSD) have 
responded by making E/PO an integral part of every science mission. 

In this section, we begin by presenting the state of science literacy and 
education in the United States and how NASA and the HSD at NASA is choosing 
to address needs for improving science education. 

1,1. US Ranking in Science, Technology, Engineering, and Mathematics 

For the past decade, US pre-college students have trailed their peers in other 
countries in their literacy levels and science and math scores. A recent 
Organization for Economic Co-operation and Development (OECD) report 
showed that the US ranked 3 1 in mathematics perfonnance and 23 in science 
among a major study of 65 countries (OECD 2011). The resulting low numbers of 
US students pursuing science, technology, engineering, and mathematics (STEM) 
higher education degrees means having to fill the nation’s STEM related 
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workforce needs externally. In response, and to fill its own STEM workforce 
needs, NASA has identified E/PO as one of its priorities. 

1.2. The NASA E/PO Umbrella 

The NASA E/PO umbrella is continually evolving, often changing its approach 
and focus. However, the fundamental basics tend to remain the same. 

NASA has three main Education goals: (1) strengthen NASA and the nation’s 
future workforce, (2) attract and retain students in science, technology, 
engineering and math (STEM) disciplines, and (3) engage Americans in NASA’s 
mission (Winterton et al., 2008). 

NASA’s Strategic Framework describes four main areas of E/PO (NASA, 
2007): 

• Higher Education: targets undergraduate and graduate students inside and 
outside of the classroom. 

• Fonnal Education: targets the K-12 system and involves standards based 
(National Science Education Standards 1996) curricula. 

• Informal Education: involves science education settings outside the 
classroom and is not tied to the National Science Education Standards. 

• Public Outreach: includes activities aimed at reaching audiences in their 
own environments and providing unique opportunities for interacting with 
significantly larger audiences. 

In an effort to support this strategic framework, NASA requires missions to 
spend a percentage of their total cost on E/PO programs closely tied to its mission. 
In the past, this amount has varied between 2% and 0.5%. The standard now is 
about 1% (SMD Science Management Council, 2010). This close link between 
missions and E/PO programs also helps ensure a tight connection between 
scientists, engineers, and the education community. 

1.3. E/PO Within the Heliophysics Science Division 

As part of the Living With a Star (LWS) program of the HSD at NASA, SDO 
must also align itself with the HSD E/PO goals and strategic communication 
objectives outlined within the Heliophysics Roadmap that builds upon the 
framework identified in the previous section. As is true with all science divisions, 
HSD sees E/PO as a key component of all flight and research programs 
(Christensen et al., 2009). However, with HSD science in mind, it highly 
encourages a more integrated set of activities that reflect the system-wide 
approach to HSD science and how we study the Sun and its effects on the solar 
system. The four strategic communication objectives as outlined in the roadmap 
are: 

• Seek opportunities to increase and maintain public awareness of 
Heliophysics science through activities, materials, and events. 

• Engage students and sustain their interest in Heliophysics-related STEM 
subjects. 

• Collaborate with and engage educators to enhance their knowledge of 
Heliophysics-related subjects and activities. 
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• Build awareness among students, educators, and the public on the diverse 
range of career opportunities related to Heliophysics science and 
missions. 

2. SDO Education and Public Outreach 

In keeping with the NASA Framework, the strategic communications 
objectives, and the system- wide approach outlined in the Heliophysics roadmap, 
The SDO E/PO team has developed an overall approach and philosophy by which 
it has built its portfolio of programs. In this section we will discuss our program 
strategies, provide a brief overview of our portfolio of programs, and conclude 
with a more in detail highlight of a select few of our programs. 

2.1. SDO E/PO Overall Approach and Philosophy 

Our guiding principles include (1) using current educational research and best- 
practices approach regarding how people leam, (2) addressing misconceptions and 
changing the perceptions and behaviors of target audiences, (3) developing 
programs that can serve as backbones to other missions and partners (4) relying 
on extensive evaluation, and (5) thinking outside the box. We will now expand on 
each of these. 

We develop our programs using current pedagogy and research into “How 
People Learn” (Bransford et ah, 2009) and how best to integrate inquiry into 
every experience. Inquiry refers to participant activities that help develop the 
knowledge and understanding of scientific ideas, as well as an understanding of 
how scientists study the natural world (National Science Education Standards, 
1996). Our research guided us to move away from teacher/moderator-centered 
resources (a model where teachers/moderators lecture to students/participants or 
run very scripted activities) and to rely instead on learner-centered resources, 
which are fundamental to effective learning experiences at all ages and levels. 

Efforts within the SDO E/PO program aim to improve people’s perceptions and 
behaviors toward science and scientists. We want to change the common 
misconceptions that all scientists are, “. . .white males . . . who work alone in a 
laboratory...” (Barman et ah, 1997), “eccentric” (McAdam, 1990), and that 
science is hard. We have found that the best approach to changing these 
perceptions is to help scientists connect their work and research with educators 
and the public. We do so by designing programs that make science more 
approachable and provide multiple opportunities for audiences to meet and 
interact with a variety of scientists and engineers. These experiences slowly break 
down the public’s false perceptions of scientists and make science more 
accessible. In doing so, we also encourage a change in audience behaviors. 
Families are encouraged to participate in more science-related activities outside 
the classroom and our programs. 

Programs are developed to serve as models or backbones. This approach 
provides two benefits: (1) it allows for the development of big picture programs 
and (2) allows other missions and institutions to easily plug into or adapt the 
program model to their own needs. This big picture approach to program 
development aligns with the Heliophysics roadmap desire to build E/PO programs 
that reflect the system-wide approach to Heliophysics science and ensures the 
public is able to more easily connect to our story and science. The plug-in model 
helps ensure sustainability of programs long after missions or small funding 
sources have run out. 
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Some form of evaluation is applied at all stages of the development cycle. A 
small percentage of resources have been allocated to the evaluation of all of our 
programs to ensure program effectiveness. Some programs have had a much more 
rigorous evaluation than others. An increased percentage of funds (20% - 30% of 
cost) have been allocated for evaluation of all post-launch efforts. This will 
provide us with the tools necessary to understand the effectiveness and impact of 
our current and future programs. 

The SDO E/PO team strives to find new and innovative ways to reach out and 
share the excitement of the mission with a broad range of audiences. This includes 
exploring unexpected venues such as the Did You Know campaign that placed 
science factoids on the back of bathroom stalls and drink coasters as well as using 
social media programs such as Facebook and Twitter to create a personality for 
the mission. Team members interact daily with followers to build a strong open 
and active dialogue with the public. 

2.2. SDO E/PO Portfolio Overview - Higher Education 

The HMI Space Weather Monitor program provides authentic space science 
instruments and hands-on access to data to students in early university (more 
below). A more sensitive research quality monitor that tracks solar and lightning- 
induced changes in the ionosphere is available for upper level and graduate 
programs. 

The AIA Montana Space Public Outreach Team (SPOT) program trains 
college students from a variety of disciplines in how to present the latest 
discoveries in space science and are then dispatched to schools and community 
organizations around the state of Montana. 

The HMI Science in Sendee program aims to instill in college students the 
necessity for performing public service no matter their future profession. Students 
from a variety of disciplines are trained in how to be effective science 
communicators and then connect them to youths in Bay Area communities 
through science mentorship and after-school science clubs. 

2.3. SDO E/PO Portfolio Overview - K-12 

The GSFC A Day at Goddard field trip brings high school physics classes to 
Goddard for a day consisting of a facilities tour, a high-tech classroom lab 
experience, and a career-oriented meet-and-greet with scientists and engineers. 

The GSFC Think Scientifically is a story-based science literature series that 
integrates a classic storybook fonnat with fundamental science to make an 
educational product that can be easily integrated into elementary school 
classrooms. 

The GSFC SDO Ambassador program connects SDO scientists, engineers, 
and E/PO staff with teachers in the DC metro area. SDO Ambassadors visit 
classrooms for a day to present SDO, participate in a Q&A session and conduct an 
SDO related hands-on activity. 

The GSFC, AIA, HMI, and EVE SDO Teacher’s Guides are a comprehensive 
set of Solar and Space Weather related activities developed for use in middle and 
high school level classes. 

The EVE Solar Science Learning Kit and associated Teacher Workshops were 
developed to support high school science courses. They include a collection of 
materials developed by the SDO E/PO team to bring Solar and Space Weather 
content into the classroom within the educational standards all teachers must 
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follow. 

The EVE SDO English as a Second Language (ESL) Space Science Course 
was a pilot program aimed at providing ESL students a unique opportunity to 
participate in science content while helping them bridge between English and 
Spanish and better integrate into the school system. 

The HMI Sudden Ionospheric Disturbance (SID) Monitors are part of the 
Space Weather Monitor program noted above and were designed to give students 
access to authentic research equipment, experiences, and data. The low-cost, high 
school version of the monitor allows students to track solar-induced changes in 
the ionosphere. 

The AIA Challenger Learning Center (CLC) Module Update program 
integrated a space weather scenario into the “Return to the Moon” and “Voyage to 
Mars” missions. During the simulated missions, students receive a CME alert 
from the SDO satellite. In detennining if the event is headed towards them, 
students leam about the magnetosphere, space weather, and solar activity. 

2.4. SDO E/PO Portfolio Overview - Informal Education 

The GSFC Family Science Night (FSN) program is designed for middle school 
children and their families. Families explore space science themes through a series 
of monthly two-hour events aimed at building their awareness of the importance 
of science in their daily lives. 

2.5. SDO E/PO Portfolio Overview - Public Outreach 

The GSFC Sunday Experiment is a program for families with young kids 
designed to provide easy access to age-appropriate science content through easy 
hands-on activities and an opportunity to meet scientists and engineers. 

The GSFC AstroZone and Exploration Station are four-hour, free to the public 
open house, held in conjunction with professional science meetings. The programs 
offer a variety of easy, family friendly, hands-on activities and an opportunity to 
interact one-on-one with scientists, engineers, and education specialist. 

The EVE Science Writers ’ Workshop held at the Laboratory for Atmospheric 
and Space Physics (LASP) prior to the launch of SDO brought 13 journalists from 
print and new media together with SDO EVE scientists. Workshop themes 
included: “The Anatomy of the Sun”, “Impact of the Solar Minimum on Climate 
and the Space Environment”, “What will Solar Max look like?” “Implications for 
Studying the Sun and for Space Weather” and “Looking to the Future: The Great 
Observatory” 

The EVE created and hosted Video Series include an overview of the EVE 
instrument ("All About EVE"), a virtual tour of LASP, and an overview of various 
space science careers. Scientists attending the above-described Science Writers' 
Workshop were also interviewed about their solar science research and those 
videos are available on YouTube. 

The GSFC and HMI SDO Social Media Campaign is comprised of the SDO 
website, Twitter feeds, Facebook fan pages, YouTube and Flickr channels, and 
several topic specific blogs. Each effort has been strategically designed and aims 
to interact with key target audiences in unique and efficient ways helping the 
mission engage the public in an infonnal conversation and create a sense of 
community around the SDO mission. 

The GSFC Did You Know Campaign focuses on reaching non-traditional 
audience in unexpected locations by providing solar and space weather related 
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factoids on signs placed on tables, the back of bathroom stalls and drink coasters. 

2.6. SDO E/PO Portfolio Overview - Highlights 

The Space Weather Monitor program: Studies confirm that the best way to 
leam science is to do science (AAAS, 1993; Boyer Commission, 1998). Based on 
this premise, this program was designed to provide authentic, space science 
instruments to students in high school and early university. The National Science 
Foundation (NSF) developed Sudden Ionospheric Disturbance (SID) monitors to 
detect changes to the Earth’s ionosphere caused by solar flares. While design of 
the low-cost instruments had been completed, no fonnal assessments had been 
made and the instruments did not come with sufficient teacher-preparation or 
supporting educational materials. The Space Weather Monitor program addressed 
this shortcoming by fonning a team of E/PO specialists and HMI scientists to 
develop and implement a 4-year test program. 

The SID monitors function by tracking Very Low Frequency (VLF) radio 
transmissions as they bounce off the ionosphere. Solar activity dramatically 
affects the Total Electron Count (TEC) in the ionosphere and hence affects the 
refraction of the VLF waves. Students use the monitors to track VLF signal 
strength, directly related to TEC and the waves’ bounce points. The monitors 
come preassembled, but students “buy in” by designing and building their own 
antenna. The systems then require a simple PC to record the data and an internet 
connection to share data [Note - internet is not required as it is generally not 
easily available in places like Africa.]. The package includes detailed teacher- 
training materials developed in partnership between the Stanford Solar Center and 
the Chabot Space & Science Center of Oakland, California, as well as an 
installation guide and research guide designed to train students to understand their 
data and encourage them to explore further research projects. 

Year-1 beta testing consisted of placing instruments in 3 local (Bay area) 
schools (2 high schools and 1 community college) with a high percentage of 
under-served students. Teachers were given direct access to HMI scientists for 
questions and clarifications. SDO scientists and other volunteers served as 
Mentors to schools that requested them. 

Year-2 was dedicated to creating a centralized data site where SID users could 
upload their data and to the distribution of over 150 instruments to high schools 
and universities throughout the US and at selected sites around the world. 

In Year-3, the program was picked up by the United Nations for use during 
the International Heliophysical Y ear (IHY) where instruments were distributed to 
about 50 countries with a focus on Developing Nations (Scherrer et al, 2008). The 
United Nations International Space Weather Initiative (IWSI) selected an 
enhanced version of the SID monitor as a participating program and instruments 
continue to be distributed to universities worldwide. Data from the SID monitors 
has been tested for use in adjusting real-time models of the inonosphere. 

In Year-4, the distribution and mentor mechanisms have been successfully 
handed off to the Society of Amateur Radio Astronomers (SARA) ensuring that 
the program continues indefinitely in a self-sustaining manner. 

The Family Science Night program: Parents and families have the greatest 
influence on children’s attitudes towards education and career choices. Research 
shows that when students have family members involved in their education, they 
show increased achievement - higher grades, improved problem-solving and 
cognitive skills (Fan et al. 2001). Based on this result, we in partnership with the 



Astrophysics Science Division developed the FSN Program for middle school 
children and their families. Middle school aged children were chosen since they 
are at an age where interest in science and math can be nurtured and when they 
are still willing to participate in programs with their families. This program was 
designed as an informal education program that allows for more flexibility in its 
content and approach, and a deeper parent/child interaction as it was out of school 
and not tied to the science education standards. 

During the FSN program, families explore space science themes through a 
series of monthly two-hour events. Our goal is to raise awareness in participating 
families of the importance of science in their daily lives and changing the way 
families think about science, within the program and beyond. We use NASA 
science content with a focus on processes and infuse SDO mission science and 
data into sessions whenever appropriate. We also provide unique opportunities for 
participants to interact with volunteer scientists and engineers. We provide parent 
professional development to help parents become effective facilitators of inquiry 
with their own families and offer opportunities for the children to become 
comfortable teaching their parents and working with them as peers. Finally, we 
encourage family science related activities outside of the program. 

Years 1-4 were been dedicated to the pilot testing of the program and refining 
of all facilitator guide materials. Our focus has shifted to the dissemination of the 
program to various locations across the USA in the year since launch. 

The SDO Social Media campaign: Through the use of social media the SDO 
E/PO team is able to engage a much wider audience, as well as engaging more 
deeply with the audience, than through traditional outlets (e.g. press releases). 
Elements of our new media plan include the use of online tools, such as Twitter, 
Facebook, YouTube, blogs, and the SDO website. These services allow not only 
for dissemination of information, but also for two-way interaction and the 
building of conversations, crucial to extended engagement of the public and 
community building. 

The NASA_SDO and NASA_SDO_EDU Twitter accounts have opened a 
constant dialogue between members of the public (i.e. followers) and members of 
the SDO E/PO, science, and engineering teams. These accounts post information 
on SDO, the sun, NASA, and interesting developments in the STEM community. 
Followers can ask questions, comment on postings, and interact with members of 
the SDO team on a one-on-one basis. During the launch of SDO and First Light- 
related events Twitter was used to include thousands of people from across the 
globe in the experience. Fifteen on-site “Twitter Correspondents” were trained to 
be effective science communicators and interact with those thousands of 
followers. Our audience included students from Romania, Mexico and Alaska, 
homeschooled families in Florida and Georgia, and 30 independently hosted 
events (events organized by members of the public not officially affiliated with 
SDO) including one in Second Life. For both launch and First Light, the term 
“Solar Dynamics Observatory” was a trending topic on Twitter for over 24 hours. 
Twitter defines a trending topic as those topics that are occupying the most 
people's attention on Twitter at any given time. It is important to note that most 
trending topics only last between 5-11 minutes and are generally associated with a 
celebrity or noteworthy news topic. 

The Facebook page has an intentionally more playful approach with updates 
made in the first person, from the satellite’s perspective. “Little SDO” interacts 
daily with its friends and followers around the world and shares a wide variety of 
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solar and space related information. This approach was chosen to give a 
personality to the spacecraft and allow followers to connect to it in the same way 
viewers connected with Disney’s Wall-E character. 

The YouTube channels stream SDO movies in a format that the public is 
intimately familiar with, and allows the viewer to easily share videos they find 
interesting with members of their social circle, while our website provides the 
background and details of the mission and serves as a resource to the public. The 
website also provides the public with easy access to the data (images and movies) 
through a variety of developed browse tools. 

3. Results 

This section provides a presentation of the results obtained for those programs 
that perfonned fonnal and informal evaluations. Fonnative assessment is 
performed throughout a programs development and provides feedback to 
developers on how to improve a program as it is built. Summative assessment is a 
final evaluation at the end of a project life to indicate if it has met its stated goals. 
Results are shown only for programs with fonnal and informal evaluation 
performed. Evaluation efforts for the Think Scientifically book series, the SDO 
Teacher ’s Guides, and various classroom resources including the EVE video 
series have not yet begun. We are awaiting the final results from the Science 
Writers ’ Workshop. NASA HQ has put the Did You Know campaign on hold due 
to its perceived flirting with the thin line of marketing. As such, no fonnal 
evaluation on the program was perfonned. 

3.1. The Space Weather Monitor Program (SID monitors) 

Extensive fonnative assessment of the program and materials was done over 
the 4-year study period, with significant involvement by SDO scientists. 

California State University graduate student Kim Ross perfonned fonnal 
summative assessment of the program. Surveys were distributed to all the SID 
installations, with a 56% response rate. Amongst other findings, 78% of 
respondents rated the program “highly effective” or better for teaching about solar 
activity and 70% rated the program as “highly effective” or better in conducting a 
scientific investigation. Summative assessment revealed that about 50% of sites 
did experience “some difficulty” with installation. The SID program is now 
successfully self-sustaining. The Space Weather Monitor program was one of 
only 2 projects highlighted for commendation in the National Research Council’s 
(NRC) report or NASA E/PO program (Quinn, et ah, 2008) 

3.2. The SPOT Program 

An external Ph.D. student from the Montana State University Education 
Department provides formal summative assessment of the program. Evaluation of 
this program focuses on the impact presentations have on students and 
communities visited. The evaluator examines the teacher-submitted evaluations as 
well as the training and retention of student presenters via phone interviews. 
Although the K-12 students are not surveyed for their interest in the presentations, 
teachers are asked to describe the level of student interest, both during and after 
the SPOT presentations. Almost three-quarters of the teachers surveyed 
commented that they could tell the students were interested because of the 
questions they were asking. This statement from a teacher is typical of these 
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remarks: Students asked many questions and were engaged during the program. 
Almost one quarter of the teachers indicated that their students continued to talk 
about the program after the presenters left. 

3.3. The Science in Service Program 

Fonnative assessment was carried out for each of the 1 st four years of the 
program. Student participants and local community leaders were involved with 
evaluation discussions after each local visit, and also completed extensive 
questionnaires at the end of the tenn. The program was iteratively adjusted when 
weaknesses were identified. At the end of the 5 years, summative assessment was 
also carried out. The focus of the final evaluation was to detennine whether the 
program was effective enough to warrant its funding and support by Stanford 
University. Extensive interviews were conducted, both with participants, involved 
HMI scientists, and local community leaders. A written report was generated, 
discussed, and evaluated. The final result of the assessment ensured that Stanford 
would assume responsibility for running the program and provide on-going 
funding to assure its continuity. The successful program is now independent of 
SDO and self-sustaining. 

3.4. A Day at Goddard 

Magnolia Consulting is performing the ongoing formal evaluation of this 
program. Evaluation data collection activities for the Day At Goddard field trips 
include student and teacher feedback surveys. Evaluators designed the student 
survey to capture students’ perceptions of the field trip components, and impacts 
on their interest and understanding of space science and related careers. 

Evaluators designed the teacher survey to gather feedback from teachers on the 
event. Feedback included teachers’ perceptions of impacts of the field trip on their 
students’ awareness of careers, interest in space science, and understanding of the 
work of NASA Goddard Space Flight Center (GSFC) scientists and engineers. 
Initial results indicate that the events are effective at engaging student interest in 
space science and provided good exposure to the work of NASA Goddard Space 
Flight Center. Hands-on activities and interactions with scientists and engineers 
are particularly engaging for students. 

Student survey results indicate that the program is successful in stimulating or 
maintaining interest in space science and science careers for the majority of 
students who attended. 48% of students indicated that they were more interested 
in science careers as a result of the program while 21% indicated that interest was 
sustained. 54% of students also indicated that they were more interested in space 
science as a result of the program while 22% indicated that interest was sustained. 

Teacher surveys found that 100% of teachers found that activities were 
effective in increasing students’ understanding of the work at GSFC, that 
activities were effective in generating students’ interest in space science, and that 
activities were effective in increasing students’ awareness of STEM careers. 

3.5. SDO Ambassador 

Magnolia Consulting is performing the ongoing formal evaluation of this 
program. Data collection activities for SDO Ambassador visits include teacher 
and student feedback surveys. Student feedback surveys include likert-scale items 
about their perceptions of the event and open-ended items about what they 
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learned, what they liked best, and what they would change. 

Results indicate that the SDO Ambassador visit was engaging and educational 
for students. Of the respondents, 97.7% agreed or strongly agreed that they had 
fun learning about solar science and that they learned new things about solar 
science from participating. 93% agreed or strongly agreed that the event made 
solar science interesting to them while 87.2% indicated that they learned about the 
Solar Dynamics Observatory from participating. We are awaiting results from the 
teacher surveys. 

3.6. The Solar Science Learning Kit and SDO ESL Space Science Course 

Dr. Tim Weston of the ATLAS Assessment and Research Center is conducting 
ongoing external evaluation of this program. The evaluator conducted interviews 
with five users of the SDO ESL Space Science Course. Interviews focused on 
perceived learning outcomes of students, fit with existing curriculum, ease of 
lesson implementation, organization, fonnat and compatibility with state 
standards. 

Results indicate that most lessons appear to be usable without major barriers 
for implementation and that content was viewed as fitting state standards. 

Concerns were expressed about the narrow range of content given the amount of 
time needed to complete lessons. Assessments were perceived as too long and 
lacking sufficient validity. 

Lessons using the SID monitor were taught at three sites. Learning outcomes 
from these lessons (e.g. collection of real data, knowledge of content) were 
perceived as valuable and fitting with existing curriculum and standards. The 
logistical component of installing the SID monitor was perceived as somewhat 
burdensome and the amount of effort needed to install the system may not justify 
outcomes. 

3.7. Family Science Night 

Dr. Noel-Storr, an external evaluator at the Rochester Institute of Technology, 
conducts the evaluation for the program. A mixed method approach is used to 
evaluate the FSN program. Tools evaluate whether the program raises the 
awareness in middle school children and their families of the importance of 
STEM in their daily lives, if the program enables all members of a family to 
engage in active learning both within and beyond the program, and if the program 
promotes connections between parents and children. 

Initial data showed that the FSN program does indeed motivate families to 
learn science together. Session observations reveal that 100% of the families 
engaged in learning science together for at least some part of every session. 
Participants were observed to be actively engaged (fully participating in activities 
with their families) in learning for approximately 75% of the total time. Almost all 
participants (90-100%), adults and children alike, were consistently able to state 
something new that they learned during each workshop as a result of the activities 
undertaken, and are able to relate what they learned to their everyday lives. FSN 
also promotes learning beyond the workshops. On average 90% of families report 
that they conducted STEM related activities as a family between workshops as a 
result of the Family Science Night program. 

The FSN program received the 2008 Robert H. Goddard Award for Exceptional 
Achievement in Outreach. 
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3.8. The Sunday Experiment 

The Sunday Experiment was handed off to the Goddard Visitor Center before 
fonnal evaluation could be conducted. However, it is important to note that one of 
its primary aims was to increase the public’s awareness of Goddard in the local 
community by increasing the number of visitors that come to the Visitor Center. 
As a result of the program, the Goddard Visitor Center now sees anywhere 
between 250 and 1000 visitors during The Sunday Experiment Program days as 
opposed to the 25 seen on other typical weekend days. 

3.9. AstroZone/Exploration Station 

Although there is no formal external evaluation of the AstroZone and 
Exploration Station events, informal surveys of participants have been collected 
along with demographic information and time spent at the event. These surveys 
help us to determine wether the stated objectives are being met. They measure 
levels of engagement, time spent at the event, as well as increased knowledge and 
interest in the available science topics and the potential for future interest in the 
STEM topics at the event. 

This evaluation has indicated that Exploration Station met or exceeded all of its 
stated objectives. The groups with minors averaged 1.5 hours in the exhibit hall 
indicating a high level of engagement: over 75% of the respondents indicated that 
they had learned some thing new at the event and were able to express what it 
was. The majority of attendees also indicated there was a topic they were 
introduced to at the event that interested them to such an extent that they were 
“likely” to conduct further inquiry into that topic. The event also scored very high 
on overall enjoyment (4.5/5). 

3.10. SDO Social Media Campaign 

We are currently working on a more integrated and effective social media 
evaluation strategy. Without a formal evaluation pedagogy, concrete insights into 
efficacy and impact are difficult at this time. However, statistics and numbers are 
available that can serve as indications of levels of success. 

Twitter: As of March 2011 the @NASA_SDO twitter feed has about 7,000 
followers with nearly 200 followers being added every month. When the account 
is put through many of the online Twitter analytics tools that look at the number 
of followers, interactions with followers, and overall popularity, it receives nearly 
perfect scores when being graded on use and shows up in the top 15% of Twitter 
accounts that have also been scored (twittergrader.com). The account has a 
consistent web influence Klout score in the mid-fifties out of 100, indicating that 
we “create content that is spread throughout [our] network and drives 
discussions”. The Klout Score is the measurement of your overall online 
influence. The scores range from 1 to 100 with higher scores representing a wider 
and stronger sphere of influence. Klout uses over 35 variables on Facebook and 
Twitter to measure True Reach, Amplification Probability, and Network Score 
(beta.klout.com). 

Facebook: SDO has over 14,000 followers between its Little SDO profile and 
Little SDO fan pages on Facebook. Trends seem to indicate that the pages get 
upwards of 1,000,000 views a month and around 14,000 comments per month to 
the information posted. It is also interesting to note that there are almost equal 
numbers of male and female followers. On average 55% of are male and 42% are 
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female. It is assumed that the remaining missing percentage is due to the option in 
Facebook not to pick a sex. 

YouTube: SDO has two YouTube channels with over 15,000 subscribers and 
3,500,000 total views between them. 

4. Discussion 

After significant evaluation, many programs have shown to meet or exceed 
their stated desired outcomes. Those programs that have not been handed off to 
partner institutions will continue to operate and in most cases, great insight was 
gained into how to improve each of the programs. Those that received more 
critical evaluation are described below and have been significantly overhauled 
accordingly and are awaiting the next round of evaluations. A small sub-set of 
programs is still scheduled for fonnal evaluations. However, informal evaluation 
and data collection of these programs still indicate they are worth continuing and 
dedicating funds to formally evaluate each of them. 

In response to the Space Weather Program (high school SID monitors) 
evaluation where 50% of sites experienced “some difficulty” with installation, an 
even easier-to-install and less-expensive (US$50) monitor, SuperSID, was 
developed along with the improvement of all support materials, and the addition 
of an official mentorship component. This new monitor is now included in the 
Solar Science Learning Kit. The program, which now includes over 450 stations, 
continues to grow and has now been handed off to the Society of Amateur Radio 
Astronomers. There has also been increased interest in these instruments as ways 
to increase student interest in science in Developing Nations, and the instruments 
continue to be distributed through the United Nations IWSI. 

SPOT program evaluation indicated a desire for more content and longer-term 
connections to the presentations. Because of the geography of Montana and the 
program’s statewide reach, it is often difficult to return to locations more than 
once, or provide on-going support to those interested. As a result, it was decided 
to develop pre- and post-presentation classroom supporting materials. Teachers 
and communities receive a packet of materials in advance of a presentation and 
are provided extra resources upon completion of the presentation. There are also 
discussions of starting a SPOT presentation teacher training workshop series. 

The Solar Science Learning Kit was developed as curriculum support material 
for the SDO ESL Space Science Course. Formal evaluation provided the following 
recommendations. Modify the curriculum to make it more modular (e.g., make 
single lessons “stand alone”) and fit lessons so they can be used in after school 
programs; standardize lesson format to more clearly emphasize objectives, 
materials and infonnation such as difficulty levels for each lesson, amount of time 
needed and prior knowledge needed to complete lesson; and change assessments 
to shorter format and develop new questions. These changes have been made and 
the latest version of the Kit is being distributed through the Colorado Science 
Teachers Space Summit, the MESA program and via videoconferences through 
the NASA Digital Learning Network. 

Evaluation results of the FSN program and four years of beta testing and 
evaluations have allowed the development of a quite comprehensive and effective 
facilitator guide and program. Although it had not been thought about it at the 
start of the program, a significant portion of children participants with minor to 
severe mental disabilities participated in the program. The majority had ADD, 
ADHD, and Asperger Syndrome. The program inherently allowed the smooth and 
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complete integration of these children who were able to participate fully in the 
program. In fact, moderators did not even become aware of these students until a 
few sessions had passed and parents would comment how this was the first 
program that allowed their children to be equals and the positive outcomes it had 
on their attitudes and self-esteem. Because this was not a goal of the program, 
there was no fonnal capturing of this finding other than through anecdotal 
evidence provided by parents. Along with funds for evaluation, a portion of funds 
have also been reserved for research into how families learn. There is little 
research currently available on how families leam. What research can be found 
indicates how important families are to children’s learning. As such, the FSN 
program hopes to contribute to this knowledge base. Fonnal evaluation of the 
program including dissemination sites will be completed in 201 1. Final results 
should be available in 2012. 

Both AstroZone and Exploration Station suffer from low turnout numbers both 
in attendees and exhibitors. The programs were developed based on the American 
Meteorological Society’s WeatherFest that sees between 4,000 and 5,000 visitors 
come through its activity exhibit hall the day before its annual meeting held each 
year in January. WeatherFest has three advantages: (1) access to televised 
meteorological staff that spread the word, (2) a local organizing committee, and 
(3) complete buy-in from the larger parent organizations (AMS and NOAA). 

These three areas are lacking in our own event. Along with improving the 
relationships with the AAS and the AGU the main areas of evaluation based 
improvement noted by both the attendees and the exhibitors were increasing the 
number of attendees and increasing the number and variety of exhibitors. This 
does not come as a surprise and feeds into the increased efforts for our advertising 
campaigns for next year. The WeatherFest model confirms the draw such 
programs have and our infonnal survey results indicate those who do participate 
are quite engaged in what the program offers. However, attendance numbers must 
dramatically increase over the next two years for this program to be worth 
continuing. Hence, the majority of the recommendations for improvement are to 
assist in creating a more effective advertising campaign targeted to our audience 
and to potential exhibitors for future event. 

Like most social media efforts, the impact of the SDO Social Media efforts is 
difficult to measure. This is compounded by the constantly changing use of 
individual methods and shifting sense of community. Funds have been allocated 
to evaluating these efforts and the team is looking to partner with others utilizing 
social media the way we do to find or develop the best tools and solutions. It will 
probably take a team of computer scientists, psychologists, and evaluation 
specialists to truly understand the effectiveness and impact of our efforts. As some 
of our bigger programs ramp down, more efforts will be allocated to this issue. 

5. Summary 

The SDO E/PO team has designed a comprehensive and well-balanced 
portfolio of programs that serve target audiences in all four of NASA E/PO areas. 
All programs have also successfully aligned themselves with NASA and 
Heliophysics goals and objectives while keeping within our guiding principles. 

The success of our programs is due in part to a significant amount of research 
performed when developing each of them, looking into best practices, what has 
been done before including what worked and didn’t work. Lessons learned are 
invaluable to any development process. As such, we have shared some of ours in 
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this paper and do so in more detail throughout many of the resources we produce 
and any of the best-practices documents we develop. 

All programs are built to improve the perceptions and behaviors of target 
audiences. The SPOT and SIS programs teach science and non-science students to 
be better science communicators, changing not only their own perceptions and 
behaviors but also those they reach. A Day at Goddard, SDO Ambassador, The 
Sunday Experiment, AstroZone and Exploration Station are positively shifting 
participant interest in science through hands-on activities and one-on-one 
interactions with scientists and engineers while FSN and the SDO ESL Space 
Science Course are significantly changing the perceptions and behaviors of 
participants through extensive sustained interaction. 

Programs such as The Sunday Experiment, FSN, and A Day at Goddard were 
built to serve as models and backbone programs that others could plug into. The 
Sunday Experiment is a nine-month program that dedicates each monthly meeting 
to a different mission or engineering challenge. The program as a whole may cost 
up to $50K a year in salaries, facilities, and materials. However, with this type of 
program, an individual mission can chose to sponsor just a single event for IK. By 
having multiple missions participate, it also means that should one mission go 
away, the program is able to continue by finding new missions to participate. This 
is also the case for each of the other programs that allow for any content to be 
easily plugged into the fonnat. Lunar and Planetary sessions have already been 
developed for FSN and 3 more Astrophysics sessions are in the pipeline. 
Sustainability is also a big part of strategy and multiple programs of ours are now 
self-sustaining beyond the SDO mission. The (CLC) Module Update, The Sunday 
Experiment, Science in Service, and the Space Weather Monitor programs have all 
been handed off to partner institutions and continue to be successfully run without 
financial support from the SDO mission. 

Thinking outside the box and being able to imagine innovative and creative 
programs is extremely important to the SDO E/PO team. Through the SDO Social 
Media campaign, the SDO E/PO team has played a key role in how NASA’s use 
of social media has evolved even hosting the first non-manned space flight launch 
Tweet-up. Prior to SDO efforts, a few missions such as Suzaku and the Mars 
rovers began blogging in the first person personifying the satellites and robots. 
Missions such as Hubble and LRO were also taking advantage of Facebook and 
Twitter. However, there was no dialogue created, simply missions posting 
infonnation for the public to read. As we were strategizing, there seemed to be 
clear signals from the public that their true desire was to be actively engaged in 
discussions. Through the SDO Facebook and Twitter accounts, the E/PO team is 
actively engaging the public and has built a strong and dedicated following that 
lets us know within seconds when one of our many online tools is no longer 
working, serving as our own core of science communicators, and even 
participating in our events at volunteers. 

Now that SDO has launched and terabytes of data are being beamed back to 
Earth daily, the SDO E/PO team will adjust its focus to include student and public 
engagement with SDO data. We will look at different ways to get data into the 
hands of students via inquiry-based projects and into the public sphere through 
social media, the press, and “citizen-science” data analysis projects. 
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